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TITLE OF THE INVENTION 
IMAGE PROCESSING APPARATUS 
BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to an image processing 
apparatus for determining, extracting and correcting 
defective pixel signals from defective pixels in an array of 
pixels in a sensor. 
Description of the Related Art 

Hitherto, the following method has been employed for 
detecting and correcting defective pixel signals from 
defective pixels within a sensor array* A detected 
defective pixel signal pattern is stored as a binary image, 
as shown in Fig. 1. In correcting an image taken of a 
subject, the stored defective pixel signal pattern is read, 
and the individual pixel signals are sequentially searched. 
If there is any defective pixel signal, it is corrected by, 
for example, replacing it with an average value of the 
surrounding pixel signals . 

If a defective pixel signal pattern is not formed, 
coordinate values of the individual defective pixels are 
stored, and corrections are performed on pixel signals 
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having the corresponding coordinates of a subject image in a 
manner similar to the above method. 

However, the ratio of defective pixels to normal pixels 
within a sensor is very small, and in searching a defective 
pixel pattern, most of the pixels are merely skipped. Thus, 
searching the whole image takes time and is wasteful. 

According to the technique using coordinate values of 
defective pixels in the sensor, a given defective pixel 
signal cannot be accurately corrected if there is another 
defective pixel near the given defective pixel in the sensor, 

SUMMARY OF TH E INVENTION 



Accordingly, it is an object of the present invention 
^5 to achieve fast and precise correction of defective pixel 

yl signals from defective pixels in a sensor array. 

In order to achieve the above object, according to one 
aspect of the present invention, there is provided an image 
processing apparatus including an extraction unit for 
20 extracting a defective pixel signal from a defective pixel 

included in an image -pickup device having a plurality of 
pixels and determining a defective pixel, and a block- 
forming unit for forming positional information of a 
plurality of the defective pixels determined by the 
25 extraction unit into a block. 
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According to another aspect of the present invention, 
there is provided an image processing apparatus including a 
storage unit for storing, in units of blocks, positional 
information of a plurality of defective pixels included in 
5 an image pickup device having a plurality of pixels, and a 

correction unit for correcting defective pixel signals of 
the defective pixels in the image pickup device in units of 
blocks by using the positional information of the defective 
pixel signals stored in the storage unit. 

m 

4q According to still another aspect of the present 

f f f invention, there is provided an image processing method 

Si including: a first step of extracting a defective pixel 

0 signal of a defective pixel included in an image pickup 

ijj device having a plurality of pixels; and a second step of 

£5 forming positional information of a plurality of defective 

pixels in the image pickup device into a block based on the 
extracted defective pixel signals. 

According to a further aspect of the present invention, 
there is provided an image processing method including: a 
20 first step of reading, in units of blocks, positional 

information of a plurality of defective pixels included in 
an image pickup device having a plurality of pixels; and a 
second step of correcting defective pixel signals of the 
defective pixels in the image pickup device in units of 
25 blocks. 



According to a yet further aspect of the present 
invention, there is provided a storage medium for storing a 
program which includes: a first step of extracting a 
defective pixel signal of a defective pixel included in an 
image pickup device having a plurality of pixels; and a 
second step of forming positional information of a plurality 
of defective pixels in the image pickup device into a block 
based on the extracted defective pixel signals. 

According to a further aspect of the present invention, 
there is provided a storage medium for storing a program 
which includes: a first step of reading, in units of blocks, 
positional information of a plurality of defective pixels 
included in an image pickup device having a plurality of 
pixels; and a second step of correcting defective pixel 
signals of the defective pixels in the image pickup device 
in units of blocks. 

According to a further aspect of the present invention, 
there is provided an image processing system including an 
image pickup device for picking up an image of a subject, an 
image processing apparatus performing image processing of a 
signal from the image pickup device, including: a storage 
unit for storing, in units of blocks, positional information 
of a plurality of defective pixels included in the image 
pickup device having a plurality of pixels; and a correction 
unit for correcting defective pixel signals of the defective 



pixels in the image pickup device in units of blocks by 
using the positional information of the defective pixel 
signals stored in the storage unit, a monitor for monitoring 
image data processed by the image processing apparatus, a 
network for transmitting the image data processed by the 
image processing apparatus, and an image database, connected 
to the network, storing the image data. 

Further objects, features and advantages of the present 
invention will become apparent from the following 
description of the preferred embodiments with reference to 
the attached drawings . 

RRTF.F DESCRIPTION OF THE DRAWINGS 

Fig. 1 schematically illustrates a conventional method 
of detecting and correcting defective pixel signals of 
defective pixels in an image pickup unit; 

Fig. 2 is a block diagram illustrating an image 
processing apparatus according to an embodiment of the 
present invention ; 

Figs. 3 and 4 are flow charts illustrating processing 
executed by the image processing apparatus shown in Fig. 2; 

Fig. 5 illustrates a method of detecting with high 
precision defective pixel signals of defective pixels in an 
image pickup unit; 



Fig. 6 illustrates extraction of defective pixel 
signals of defective pixels in an image pickup unit; 

Fig. 7 illustrates run-length coding of position 
information ; 

Fig. 8 illustrates extraction of defective pixel 
signals and embedding of corrected defective pixel signals 
in place of corresponding defective pixel signals in an 
image signal; 

Fig. 9 illustrates correction of defective pixel 
signals ; 

Fig. 10 illustrates correction of defective pixel 
signals taking the arrangement of a filter into 
con s ider at ion ; and 

Fig. 11 illustrates the entire configuration of a 
digital X-ray system using an image processing apparatus 
according to the invention. 

DESCRIPTION OF THE PR EFERRED EMBODIMENT 

Fig. 2 illustrates the system configuration of an image 
processing apparatus according to an embodiment of the 
present invention. Figs. 3 and 4 are flow charts 
illustrating processing executed by the image processing 
apparatus shown in Fig . 2 . 

The image processing apparatus shown in Fig. 2 includes 



the following elements. An image input unit 5, which serves 
as an image pickup device, receives a pixel signal from a 
sensor having an array of a plurality of pixels , such as 
from an X-ray sensor, A data storage unit 6 stores 
information of, for example, defective pixels. An image 
processing unit 7 performs image processing on the defective 
pixel signal input into the image input unit 5 by using the 
information stored in the data storage unit 6. A system 
control unit 8 controls the image input unit 5, the data 
storage unit 6, and the image processing unit 7. 

Extracting defective pixel signals and storing 
positional information of defective pixels is discussed 
below with reference to Figs. 2 and 3. 

In Fig. 3, in step SI, the image input unit 5 receives 
a pixel signal of a white image, which has been taken 
without a subject, from the sensor. In step S2, the system 
control unit 8 causes the image input unit 5 to transmit the 
input pixel signal to the image processing unit 7 and 
instructs the image processing unit 7 to extract defective 
pixel signals. The image processing unit 7 then extracts 
all the defective pixel signals. In step S3, in response to 
an instruction from the system control unit 8, the image 
processing unit 7 combines a plurality of items of 
coordinate data, which indicate positional information of 
the defective pixels extracted by the operation in step S2, 



into a block. Then, in step S4 , the system control unit 8 
stores the blocks of coordinate data in the data storage 
unit 6 . 

The operations in steps S2 and S3 are discussed below 
in detail. 

Concerning the extraction of defective pixel signals in 
step S2, a certain threshold may be set, and pixel signals 
having a value smaller than the threshold may be determined 
to be defective pixel signals from corresponding defective 
pixels in the sensor. 

According to a technique of detecting defective pixel 
signals with higher precision, a white image is divided into 
blocks, as shown in Fig. 5, and an average signal value and 
a standard deviation from the average signal value within 
each block are determined. Then, pixel signals having a 
signal value which is outside a range of (the average signal 
value ± (n x standard deviation)), where n is a specified 
signal value, are determined to be defective pixel signals. 

Correction of defective pixel signals in step S3 is as 
follows. The plurality of items of coordinate data of the 
defective pixel signals detected in step S2 are formed into 
one block, as shown in Fig. 6. As an example of techniques 
of forming the coordinate data into a block of positional 
information (local defective -pixel information), a run- 
length coding technique shown in Fig. 7 may be employed. 



In run-length coding, defective pixels which are 
continuously located in an X direction (horizontal 
direction) or a Y direction (vertical direction) are 
integrated into a group, and the first coordinate value and 
the length (and the direction if necessary) of the group are 
coded . 

A technique of forming the plurality of items of 
defective pixels into groups by using the above -described 
run-length coding is as follows. For simple representation, 
run-length coding is performed only in the X direction. 

For example, as shown in Fig. 7, since a pixel having 
coordinates (n,m) and a pixel having coordinates (n+l,m) are 
adjacent to each other with a length 2 in the X direction, 
they are coded into information (n,m) L2. Similarly, a 
pixel (n+l,m+l) and a pixel (n+2,m+l) are coded into 
(n+l,m+l) L2, and pixels (n,m+2), (n+l,m+2), (n+2,m+2), 
(n+3,m+2) are coded into (n,m+2) L4. Then, as another run^ 
length code positioned adjacent to a given run- length code, 
pixels having ±1 Y coordinate are extracted. Among these 
pixels, pixels which are continuously placed in the X 
direction are grouped into a run-length code. In Fig. 7, if 
a given run- length code is determined to be (n # m) L2, pixels 
having ±1 Y coordinate and continuously located from X 
coordinate (n+1) are selected as a run- length code (n+l,m+l) 
L2 adjacent to the given run-length code (n,m) L2. The 



- 10 - 



above -de scribed operation is performed to obtain all the 
run-length codes, thereby integrating all the defective 
pixels into groups of local defective-pixel information. 

The coordinate data of the defective pixels may be 
formed into blocks by a technique other than the above - 
described run-length coding. For example, by using normal 
x- and y-coordinate positional data, eight pixels in 
proximity with each other in the sensor may be checked for 
any adjacent defective pixels by checking the corresponding 
pixel signal values, and coordinate data of all the adjacent 
defective pixels may be determined and extracted and formed 
into one block based on the extracted defective pixel 
signals, which indicates positional information (local 
defective-pixel information). According to the run-length 
coding technique, however, the amount of positional 
information of defective pixels is smaller than that of the 
above- described technique. Thus, run-length coding is more 
advantageous in terms of reducing the storage area. 

However, a different coding technique may be employed 
to reduce the storage area instead of the run-length coding 
technique . 

Correction of defective pixel signals is discussed 
below with reference to Figs. 2 and 4. 

Referring to Fig. 4, in step S5, the control unit 8 
obtains the local defective -pixel information stored in the 



data storage unit 6. Then, in step S6, the image processing 
unit 7 extracts an area which is required to be corrected 
from the subject-image signal based on the local defective- 
pixel information obtained in step S5 . In step S7, the 
defective pixel signals within the extracted area are 
corrected. Finally, in step S8, the corrected image signal 
formed by the corrected defective pixel signals is embedded 
into the original subject-image signal by replacing the 
defective pixel signals. According to the above-described 
operation, corrections are repeatedly performed on all the 
items of local defective -pixel information. 

The operations of steps S6 and S7 are described below 
in detail with reference to Figs. 8 and 9. 

In step S6, a local defective -pixel block corresponding 
to the local defective-pixel information stored in the data 
storage unit 6 is extracted, as shown in Fig. 8, from an 
image signal obtained by taking an image of a subject. The 
local defective-pixel block includes defective pixels and 
pixels required for correcting the defective pixel signals. 
The local defective-pixel information may include positional 
information concerning only defective pixel signals or 
include positional information concerning both defective 
pixels and pixels required for correcting the defective 
pixel signals. If the local defective -pixel information 
includes only positional information of the defective pixels. 
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an area which is required to be corrected must be calculated 
by the control unit 8 based on the defective-pixel 
positional information. If, however, the positional 
information of the above-described area is also included in 
the local defective-pixel information, the time for 
calculations can be reduced, thereby enabling a faster 
operation. 

In step S7, a defective pixel signal is corrected, as 
shown in Fig. 9, by an average of the pixel signals of the 
surrounding eight pixels. In this case, among the 
surrounding eight pixels, defective pixel signals cannot be 
utilized. In this embodiment, however, any defective pixel 
signals of defective pixels near a given defective pixel are 
extracted together with the defective pixel signal of the 
given defective pixel and are formed into a single block. 
It is thus possible to determine which pixel signals cannot 
be utilized for corrections. The corrected pixel signals 
(local corrected pixel signals) are then embedded into the 
original image in place of the defective pixel signals. 

Although in the foregoing embodiment a given defective 
pixel signal is corrected by the average pixel signal of the 
surrounding eight pixels, the average pixel signal of the 
surrounding four pixels in the vertical and horizontal 
directions may be used. In this case, defective pixels 
obliquely adjacent to the given defective pixel in the 
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sensor may not be necessarily formed into the same group as 
the given pixel, and it is essential only that defective 
pixels vertically or horizontally adjacent to the given 
defective pixel in the sensor may be formed into the same 
group as the given defective pixel. 

The number of pixels used for corrections may be 
increased, in which case, the weighted mean of an increased 
number of pixels may be used. 

In using a sensor with color filters, such as the one 
shown in Fig. 10, a defective pixel signal of a given 
defective pixel of a blue (B) or red (R) color cannot be 
corrected by using pixel signals of adjacent pixels. 
Accordingly, as illustrated in Fig. 10, if a defective pixel 
is contained in the surrounding B-coloroeight pixels around 
a B-color pixel which is to have its defective pixel signal 
corrected, it is required to be formed into one group. 

As discussed above, pixels can be formed into a 
suitable block range according to which pixel signals are to 
be used for correcting defective pixel signals. Positional 
information of the defective pixel signals by blocks is 
stored in the data storage unit 6, and is extracted by 
blocks, thereby achieving fast correction of defective pixel 
signals. It is also possible to determine which pixels in 
the sensor are defective pixels. 

In the above-described embodiment, defective pixel 



signals are extracted and are formed into a block, and are 
then corrected in the image processing unit within a single 
image processing apparatus. However, different image 
processing apparatuses may be employed. That is, defective 
pixel signals may be extracted and formed into a block in 
one image processing apparatus, and may then be corrected in 
another image processing apparatus . 

Fig. 11 illustrates the entire configuration of a 
digital X-ray system using the image processing apparatus of 
the foregoing embodiment . 

In Fig. 11, the digital X-ray system includes an X-ray 
sensor 1 for receiving X rays, a subject (for example, a 
patient) 2, an X-ray generating device (X-ray source) 3, an 
X-ray-generating-device control unit 4, the image processing 
apparatus 20 of the above -described embodiment for 
performing predetermined image processing in response to a 
signal from the X-ray sensor 1, a diagnosis monitor 9 for 
monitoring an image processed in the image processing 
apparatus 20, an operation unit 10 for performing a 
predetermined operation on the image processing apparatus 20, 
a network 11, which is a transmission medium for 
transmitting the image data processed by the image 
processing apparatus 20, a printer 12 for outputting the 
image data, a diagnosis workstation 13 installed with a 
diagnosis monitor for monitoring image data, and an image 



database 14 for storing Image data. 

A storage medium for storing software program code 
which implements the functions of the above -de scribed 
embodiment may be supplied to a system or a device. Then, a 
computer (or CPU or an MPU) of the system or the device may 
read the program code stored in the storage medium and 
execute it, so that the above-described functions can be 
implemented . 

In this case, program code itself implements the 
functions of the foregoing embodiment, and a storage medium 
for storing the program code constitutes the present 
invention. 

Examples of the storage medium for storing the program 
code include a floppy disk, a hard disk, an optical disc, a 
magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a 
non -volatile memory card, and a ROM. 

The function of the foregoing embodiment can be 
implemented not only by running the program code read by the 
computer, but also by partially or wholly executing the 
processing by, for example, an operating system (OS) or 
another application software program running in the computer 
according to instructions of the program code. 

The present invention may also be implemented by the 
following modification. The program code may be read from 
the storage medium into a memory provided in a feature 



expansion board inserted into a computer or a feature 
expansion unit connected to the computer. Then, a CPU 
provided in the feature expansion board or the feature 
expansion unit may partially or wholly execute the 
processing based on the instructions of the program code, 
thereby implementing the above -described functions. 

As is seen from the foregoing description, the present 
invention offers the following advantages. Fast and precise 
correction of defective pixel signals can be achieved. 
Additionally, a storage area required for defective pixel 
information can be reduced by utilizing, for example, run- 
length coding. 

While the present invention has been described with 
reference to what are presently considered to be the 
preferred embodiments , it is to be understood that the 
invention is not limited to the disclosed embodiments. On 
the contrary, the invention is intended to cover various 
modifications and equivalent arrangements included within 
the spirit and scope of the appended claims . The scope of 
the following claims is to be accorded the broadest 
interpretation so as to encompass all such modifications and 
equivalent structures and functions. 



